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Abstract. We show that forbidden patterns problems, when restricted to some classes of 
input structures, are in fact constraint satisfaction problems. This contrasts with the case 
of unrestricted input structures, for which it is known that there are forbidden patterns 
problems that are not constraint satisfaction problems. We show that if the input comes 
from a class of connected structures with low tree-depth decomposition then every forbidden 
patterns problem is in fact a constraint satisfaction problem. In particular, our result 
covers input restrictions such as: structures of bounded degree, planar graphs, structures 
of bounded tree-width and, more generally, classes definable by at least one forbidden 
minor. This result can also be rephrased in terms of expressiveness of the logic MMSNP, 
introduced by Feder and Vardi in relation with constraint satisfaction problems. Our 
approach follows and generalises that of Nesetf il and Ossona de Mendez's, who investigated 
restricted dualities, which corresponds in our setting to investigating the restricted case 
when the considered forbidden patterns problems are captured by a first-order sentence. 
Note also that our result holds in the general setting of problems over arbitrary relational 
structures (not just for graphs). 



Constraint satisfaction problems have been first investigated in artificial intelligence as a 
generic concept covering a wide range of combinatorial problems. The input of such a prob- 
lem consists of a set of variables, a set of values for these variables and a set of constraints 
between these variables; the question is to decide whether there is an assignment of values to 
the variables that satisfies all the constraints. Note that these sets (of values, variables and 
constraints) are usually assumed to be finite, thus in particular such problems do not cover 
constraints over integers or over reals. However, this framework remains general enough to 
cover a variety of well-known problems such as Boolean satisfiability, graph 3-colourability, 
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and conjunctive query evaluation; and, more importantly for us as it is the approach we 
shall adopt in this paper, constraint satisfaction problems can be phrased as homomorphism 
problems. For further details, we suggest the survey [19] which gives a detailed background 
on the intimate connection between constraint satisfaction problems, database theory and 
finite model theory. Graph homomorphisms and related problems have received consider- 
able attention in recent years as a topic in combinatorics, and the monograph [18] serves as 
a good survey of the area. 

The theoretical investigations of constraint satisfaction problems have been concerned 
mostly with computational complexity; in particular, with the dichotomy conjecture, that 
asserts that every constraint satisfaction problem is either tractable (polynomial time de- 
cidable) or intractable (NP-complete) . This conjecture is supported by early results in the 
Boolean case [32J and in the case of graph homomorphism [T7] ; and, by later results using 
tools from universal algebra [5]. So, despite the fact that constraint satisfaction problems 
capture numerous well-known problems in NP, the dichotomy conjecture suggests a funda- 
mental difference with the class NP (recall Ladner's Theorem [23] which states that if P is 
different from NP then there is an infinite number of distinct polynomial-time equivalence 
classes in NP). 

Investigations on the fundamental properties of constraint satisfaction problems have 
also focused on their descriptive complexity. Based upon Fagin's logical characterisation of 
NP as those problems expressible in the existential fragment of second order logic, Feder 
and Vardi attempted to find a large (syntactically-defined) sub-class of NP which exhibits 
the dichotomy property [TT]. What emerged from Feder and Vardi's consideration was the 
logic MMSNP (short for Monotone Monadic SNP without inequalities) defined by imposing 
syntactic restrictions upon the existential fragment of second-order logic. Though syntac- 
tically defined this logic is very combinatorial in nature, in the sense that every sentence 
corresponds to a finite set of coloured obstructions: this was made precise in J2H], where 
Madelaine and Stewart introduced a new class of combinatorial problems, the so-called for- 
bidden patterns problems, and proved that every sentence of MMSNP defines a finite union 
of forbidden patterns problems (since we only deal with decision problems in this paper, we 
equate a problem with the set of its yes-instances). Feder and Vardi were unable to prove 
that MMSNP has the dichotomy property, a question which remains open, but showed that 
this logic is "computationally" equivalent to the class of constraint satisfaction problems. 
This result, together with Kun's derandomisation |20| of a particular graph construction 
used in Feder and Vardi's reduction, implies that MMSNP has the dichotomy property if, 
and only, if the dichotomy conjecture holds. So, one could argue that MMSNP and the 
class of constraint satisfaction problems are essentially the same. 

However, as was first observed by Feder and Vardi, the logic MMSNP is too strong: 
there are forbidden patterns problems which are not constraint satisfaction problems |11[ [25] . 
Moreover, Bodirsky and Dalmau [3 showed that forbidden patterns problems are in fact 
examples of well-behaved constraint satisfaction with a countable set of values (which shall 
be referred as infinite constraint satisfaction problems thereafter). So, in the context of 
descriptive complexity, the logic MMSNP and constraint satisfaction problems are rather 
different. In [26 , Madelaine and Stewart gave an effective characterisation of forbidden 
patterns problems that are constraint satisfaction problems: given a forbidden patterns 
problem, we can decide whether it is a finite or infinite constraint satisfaction problem; 
and, in the former case, we can compute effectively a description of this problem as a finite 
constraint satisfaction problem. Since the transformation of a sentence of MMSNP into a 
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finite union of forbidden patterns problems is also effective, as a corollary, we can decide 
whether a given sentence of MMSNP defines a finite union of (finite) constraint satisfaction 
problems, or defines a finite union of infinite constraint satisfaction problems. 

The question of expressivity of the logic MMSNP with respect to the class of constraint 
satisfaction problems is also being studied in a different guise in structural combinatorics. 
For example, the above result, which delineates the border between forbidden patterns 
problems and constraint satisfaction problems (respectively, MMSNP and finite union of 
constraint satisfaction problems), subsumes the characterisation of duality pairs (respec- 
tively, finite dualities) obtained by Tardif and Nesetfil [31] (see also the sequel paper [13]). 
Moreover, Kun and Nesetfil give a new proof of the characterisation of forbidden patterns 
problems that are constraint satisfaction problems |21j . Their elegant approach involves 
lifting dualities to a more complex form of dualities. However, contrary to Madelaine and 
Stewart's result, note that this approach is not effective. The present paper is motivated 
by another kind of duality known as restricted duality, which corresponds to restricting the 
studied problems to a particular class of inputs. Contrary to the case of duality, for par- 
ticular restrictions, e.g. for bounded degree pH] or planar graphs [28 , it turns out that we 
have all restricted dualities. This provokes the following question, which is the object of this 
paper. For which input restrictions, do all forbidden patterns problems become constraint 
satisfaction problems? 

Before we can discuss in more detail our contribution, let us introduce more precisely 
duality and restricted duality. A duality pair is a pair (F, H) of structures such that, for 
every structure G, there is no homomorphism from F to G (we say that G is .F-mote) if, 
and only if, there is a homomorphism from G to H (we say that G is homomorphic to 
H). There are structures F, for which there is no H such that (F,H) is a duality pair 
(for example, choose F to be the triangle). In this sense, we do not have all dualities. 
However, when we turn to restricted duality, that is when G in the above definition ranges 
over a particular class of structures, there are examples in which we have all dualities. For 
example, Haggkvist and Hell [16] showed how to build a finite "universal" graph H for the 
class of F-mote graphs of bounded degree b. That is, any degree b graph G is F-mote if, 
and only if, there is a homomorphism from G to H . Note that the usual notion of universal 
graph, as used by Fraisse p3] is for induced substructures, not homomorphism, and that 
the universal graph is usually countable. In our context, the word universal graph refers to 
a finite graph and is universal with respect to the existence of homomorphisms. 

Nesetfil and Ossona de Mendez [30J introduced the notion of tree-depth of a graph 
and of low tree-depth decomposition of a class of graphs. They show a restricted duality 
theorem for restriction to classes of low tree-depth decomposition: this includes graphs of 
bounded degree, planar graphs, graphs of bounded tree-width, any proper minor closed 
class and, more generally, classes of bounded expansion. In Figure [T] we have depicted how 
these classes compare. See [28] for further details on these classes, and for the algorithmic 
features that the existence of such low tree-depth decomposition provides. In this paper, 
we generalise the approach taken in [30 and show for arbitrary relational structures, not 
just for graphs, that every forbidden patterns problem is a constraint satisfaction problem 
when restricted to a class of connected structures that has a low tree-depth decomposition. 
Since this case is technically much more involved than the simple case of bounded-degree 
inputs, as a warm-up case to illustrate the basic concepts, we first show that every forbidden 
patterns problems restricted to connected inputs of bounded degree becomes a constraint 
satisfaction problem (this result already appeared in a conference paper [9]). Next, we 
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Figure 1: Classes of graphs and how they compare. 

extend this result and prove that every forbidden patterns problem when restricted to a 
class of connected structures with low tree-depth decomposition is a constraint satisfaction 
problem. Examples of classes of structures with this property are proper minor closed classes 
(this result was originally presented in this restricted case in the preliminary version of this 
paper [M]); classes of bounded degree and, more generally, classes of bounded expansion. 

A well-known extension of monadic second order logic consists of allowing monadic 
predicates to range over tuples of elements, rather than just elements of a structure. This 
extension is denoted by MSO2 whereas the more standard logic with monadic predicates 
ranging over elements only is denoted by MSOi. In general, MSO2 is strictly more expres- 
sive than MSOi. However, Courcelle [7] proved that MSO2 collapses to MSOi, for some 
restriction of the input: for graphs of degree at most k, for graphs of tree- width at most k 
(for any fixed k), for planar graphs and, more generally, for graphs belonging to a proper 
minor closed class (a class % such that: a minor of a graph G belongs to % provided that 
G belongs to 3C; and, % does not contain all graphs). It is perhaps worth mentioning that 
in j9j E3] and the present paper we assume a definition of forbidden patterns problems that 
is more general than the original one in [26] in that the new definition allows colourings not 
only of the elements of the input structure but also of its tuples of elements. Essentially, 
this means that we are now considering problems related to MMSNP2, the extension of 
MMSNP with "edge" quantification (for clarity, from now on, we denote by MMSNPi the 
original logic, i.e. without edge quantification). This means that the main result of this 
paper provides us with a theorem analogous to that of Courcelle but concerning equal ex- 
pressivity of the logics MMSNP 1 and MMSNP2 (they both capture the class of constraint 
satisfaction problems, when suitably restricted). Courcelle extended the above result to 
uniformly sparse graphs [8^ . However, as we shall see our result fails in this case: there is a 
problem in MMSNP 1 which is not a constraint satisfaction problem and since this problem 
is very restricted, it follows in fact that uniformly /c-sparse graphs do not have all restricted 
dualities, for any fixed k > 2. 

As a further motivation for the definition of MMSNP2 we show that this logic, just like 
MMSNPi, correspond to infinite constraint satisfaction problems in the sense of Bodirsky[2j 
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The paper is organised as follows. In Section [T] we define constraint satisfaction prob- 
lems, forbidden patterns problems and give some examples. We conclude this section by a 
brief review of results on restricted dualities and we state the main result of this paper. 

In Section |2j we prove that forbidden patterns problems are constraint satisfaction 
problems when restricted to connected structures of bounded degree. This serves as a warm 
up case to illustrate the main definitions and concepts. 

In Section [3j we prove our main result, that is that forbidden patterns problems are 
constraint satisfaction problems when restricted to a class of connected structures that have 
low tree-depth decomposition. In order to do so, we first introduce the notion of tree-depth 
for structures. Then, we show that coloured structures of bounded tree-depth have bounded 
cores. We conclude the proof by the construction of a finite universal coloured structure, 
using the existence of a low tree-depth decomposition for every input. 

In Section [4j we turn to logical aspects. We define MMSNPi, recall some known results 
for this logic and extend them to MMSNP2. Next, we reformulate our main result in terms 
of expressivity of the logics MMSNP2 and MMSNPi with respect to constraint satisfaction 
problems. We compare this result with Courcelle's result on the expressivity of MSOi and 
MSO2. We conclude this section by proving that problems in MMSNP2 are also infinite 
constraint satisfaction problems in the sense of Bodirsky. 

In the last section, we conclude and discuss related work and open questions. 

1. Preliminaries 

1.1. Constraint satisfaction problems and forbidden patterns problems. Let a be 

a signature that consists of finitely many relation symbols. From now on, unless otherwise 
stated, every structure considered will be a a-structure. Let S and T be two structures. A 
homomorphism h from S to T is a mapping from |5| (the domain of S) to \T\ such that for 
every r-ary relation symbol R in a and any elements x\, X2, ■ ■ ■ , x r of S, if R(xi, X2, ■ ■ ■ , x T ) 
holds in S then R{h{x\), h(x2), ■ ■ ■ , h{x r )) holds in T. If there exists a homomorphism from 
S to T we say that S is homomorphic to T. 

The constraint satisfaction problem with template T is the decision problem with, 

• input: a finite structure S; and, 

• question: does there exist a homomorphism from S to T? 

We denote by CSP the class of constraint satisfaction problems with a finite template. 

Example 1.1. The constraint satisfaction problem with template K$ (the clique with 
three elements, i.e. a triangle) is nothing other than the 3-colourability problem from graph 
theory. 

Let V (respectively, £) be a finite set of vertex colours (respectively, edge colours). A 
coloured structure is a triple (S, s v , s £ ), where S is a structure, s v is a mapping from | *S' | to 
V and s is a mapping from E(S) to £ where, 

E(S) := {(R, xi, X2, . . . , x r ) s.t. R(xi, X2, ■ ■ ■ , x r ) holds in S}. 

Let (S, s v , s £ ) and (S' , s' V , s'^) be two coloured structures. A colour-preserving homomor- 
phism h from S to S' is a homomorphism from S to S' such that s' oh = s v and for every tu- 
ple t = (R, xx, X2, • • • , x r ) in E(S), s 1 (t') = s E (t), where t' := [R, h(x\), h(x2), ■ ■ ■ , h(x r )) . 
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When the colours are clear from the context, we simply write that h preserves colours. Note 
that the composition of two homomorphism that preserve colours is also a homomorphism 
that preserves colours. 

A structure S is connected if it can not be partitioned into two disjoint induced sub- 
structures. A pattern is a finite coloured structure (F, f v , / £ ) such that F is connected. In 
this paper, patterns are used to model constraints in a negative fashion and consequently, 
we refer to them as forbidden patterns. Let $ be a finite set of forbidden patterns. We say 
that a coloured structure (S, s v , s £ ) is valid with respect to 5 if) and only if, for every for- 
bidden pattern (F, f v , / £ ) in 5 ; there does not exist any colour-preserving homomorphism 
h from F to S. 

The problem with forbidden patterns $ is the decision problem with, 

• input: a finite structure S 

• question: does there exist s v : \S\ — > V and s £ : E(S) —* £ such that (S, s v , s £ ) is valid 
with respect to J? 

We denote by FPPi the class of forbidden patterns problem with vertex colours only (that 
is for which £ has size one) and by FPP2 the class of forbidden patterns problems. 

Examples 1.2. Let G be an undirected graph. It is usual to represent G as a relational 
structure with a single binary relation E that is symmetric. However, the logics considered 
in this paper are monotone and we can not express that E is symmetric; therefore, we use 
a different representation to encode graphs. We say that a structure S with one binary 
relation symbol E encodes G, if |5"| = V{G) and for any x and y in V(G), x and y are 
adjacent in G if, and only if, E{x,y) or E(y,x) holds in S. Note that this encoding is 
not bijective. Modulo this encoding, the following graph problems are forbidden patterns 
problems. 

(1) Vertex-No-Mono-Tri: consists of the graphs for which there exists a partition of the 
vertex set into two sets such that no triangle has its three vertices occurring in a single 
partition. It was proved in [2"5] that this problem is not in CSP and in [lj that it is 
NP-complete. 

(2) Tri-Free-Tri: consists of the graphs that are both three colourable (tripartite) and 
in which there is no triangle. It was proved in [25] that this problem is not in CSP. It 



follows from [20 that this problem is NP-complete. 

(3) Edge-No-Mono-Tri: consists of the graphs for which there exists a partition of the 
edge set in two sets such that no triangle has its three edges occurring in a single 
partition. It is known to be NP-complete (see [15]). 

The above examples can be formulated as Forbidden Patterns Problems. The corresponding 
sets of forbidden patterns are depicted on Figure [2j In the case of Edge-No-Mono-Tri, 
the two type of colours for edges are depicted with dashed and full line respectively. 

1.2. Restricted Dualities. Let S be a class of structures. We say that C has all restricted 
dualities if, and only if, for every finite set of connected structures $ there exists a finite 
structure U, the so-called universal structure, such that for every structure A in C there is 
no homomorphism from any F in J to A if, and only if, A is homomorphic to U. 
The first example of a restricted duality theorem is due to Haggvist and Hell. 

Theorem 1.3. [TB] Let b be an integer and C be a class of graphs. If every graph in Q has 
bounded degree b then C has all restricted dualities. 
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Figure 2: Some forbidden patterns problems 



More recently, Nesetfil and Ossona de Mendez gave a duality theorem for proper minor 
closed classes. 

Theorem 1.4. [30] Let M be a graph and C be a class of graphs. If no graph in C admits 
M as a minor then C has all restricted dualities. 

One of the key notions in the proof is that of a low tree-depth decomposition (see 



Section 3.3 for a definition). More recently, the same authors have introduced the notion 



of classes of graphs of bounded expansion, which encompasses both classes of graphs of 

bounded degree and proper minor closed classes. A class of graphs S has bounded expansion 

if there exists a function / : N — ► M such that for every graph G in C and every r > 0, V r (G), 

\E(G\ 7) I 

the so-called grad of G of rank r is bounded by /(r), where V r (G) = max - — W • Here, T 
is a set of disjoint sets of vertices of G, each of which induce a connected subgraph of G; 
and, E{G\y) denotes the edge set of the minor of G constructed by identifying the vertices 
inside each set into a single vertex and deleting other vertices and edges. These authors 
proved that classes of graphs of bounded expansions have also low tree-depth decomposition 
and proved the following general result. 

Theorem 1.5. [27] Let C be a class of graphs. If C has bounded expansion then C has all 
restricted dualities. 

Example 1.6. We can use restricted duality results, such as those presented above, and ad 
hoc techniques from |9 to show that two of our examples are constraint satisfaction problems 
when restricted to a suitable class % (e.g. class of graphs of bounded degree, proper minor 
closed class or, more generally, class of bounded expansion; in fact, any class for which we 
have a suitable restricted duality result). Let U be the universal graph for $ = {K3}. Let 
U' be the product of U with K%. Recall that this is the graph with edge set \U\ x \K%\ 
and with an edge E((u,x), (v,y)) if, and only if both E(u,v) in U and E(x,y) in K%. It 
is not difficult to check that Tri-Free-Tri, restricted to % is the constraint satisfaction 
problem with template U' . Similarly Vertex-No-Mono-Tri is the constraint satisfaction 
problem with template U" , where U" is the graph that consists of two copies of U, such 
that every pair of elements from different copies are adjacent. Note that, technically, our 
problems being defined over structures with a single binary relation E, we have not really 
expressed them as a constraint satisfaction problem. However, according to our encoding, 
replacing any two adjacent vertices x and y in the above graphs by two arcs E(x, y) and 
E(y, x) provides us with a suitable template. 
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1.3. Restricted Coloured Dualities. We say that C has all restricted coloured dualities 
if, and only if, for every finite set of forbidden patterns 5 there exists a finite structure 
U, the so-called universal structure, such that for every structure A in C, A is valid with 
respect to 5 [J] if) an d only if, A is homomorphic to U. 

We say that a structure S has bounded degree b if every element of S occurs in at 
most b distinct tuples. We extended the previous result to restricted coloured dualities (we 
provide the proof of this result for completeness in Section [2]) . 

Theorem 1.7. [9] Let b be an integer and C be a class of structures. If every structure S 
in 6 has bounded degree b then C has all restricted coloured dualities. 



In the preliminary version of this paper J2I], we extended Theorem 1.4 to restricted 
coloured dualities. We also extended the result to structures, rather than just graphs. Let 
us make precise what we understand by a proper minor closed class of structures. Let S 
be a structure. The Gaifman graph of S, which we denote by 9s is the loopless graph with 
vertices \S\ in which two distincts elements x and y of S are adjacent if, and only if, there 
exists a tuple in a relation of S in which they occur simultaneously. Given a class % of 
structures, we denote by Sjc the class of their Gaifman graphs. A class of graphs 3 is said to 
be a proper minor closed class if the following holds: first, for any graph G and any minor 
H of G, if G belongs to S then so does H; and, secondly S does not contain all graphs. 
Alternatively, 9 is proper minor closed if it excludes at least one fixed graph M as a minor, 
a so-called forbidden minor. We say that a class of structures IK is a proper minor closed 
class if, and only if, is a proper minor closed class. 

Theorem 1.8. [21] Let C be a class of structures. If Q is a proper minor closed class then 
C has all restricted coloured dualities. 

The key property we use in the proof of this result, namely that such a proper minor 
closed class has low tree-depth decomposition, holds also in the general case of a class of 
(structures) of bounded expansion defined similarly as follows. A class of structures % is 
of bounded expansion if, and only if, Sac is of bounded expansion. Thus, a similar proof 
provides us in fact with the following more general result which subsumes also Theorem |1.7| 



Theorem 1.9. Let C be a class of structures. If C has low tree-depth decomposition (e.g. 
bounded degree, proper minor closed class, structure of bounded expansion) then C has all 
restricted coloured dualities. 

Section [3] is devoted to the proof of this result. 

Example 1.10. The last of our examples Edge-No-Mono-Tri is also a constraint satis- 
faction problem when restricted to a class % that has low tree-depth decomposition by the 
above result. 



2. Bounded Degree 



In this section, we give a proof of Theorem 1.7 To simplify the notation we will consider 
graphs only but the proof extends to relational structures without major difficulty We shall 
first explain the intuition and ideas behind the proof by giving an informal outline. Let us 
denote the largest diameter of a forbidden pattern by m. This parameter, together with 



^That is there is no suitable colouring of A (see definition of validity on page 
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the degree-bound b, are constants, i.e. they are not part of the input of the forbidden 
patterns problem. The universal graph U has to contain all possible small graphs that are 
yes-instances of the forbidden patterns problem, "small" meaning "of diameter m + 1" here 
and thereafter. The intuition then is that each graph G, which is a yes-instance of the 
forbidden patterns problem, however big, can be homomorphically mapped to U as such 
a mapping should be only locally consistent. Given that the degree of G is bounded by b, 
we need to distinguish among no more than X vertices in a small neighbourhood, where X 
depends on b and m. So we can use X many different labels in constructing the vertex set 
of U. On the other hand, in order to define the adjacency relation of the universal graph, 
i.e. to correctly "glue" all the possible small neighbourhoods, any vertex of U should carry 
information not only about its label, but also about its neighbourhood. In other words, any 
such vertex will represent a small graph together with a vertex which is the "centre" (or the 
root) of the small graph. Thus the vertex set of the universal graph will consists of all such 
rooted small graphs, vertex- and edge-coloured in all possible ways, that are yes-instances 
of the forbidden patterns problem. Two vertices will be adjacent in U if, and only if, the 
graphs they represent "agree", i.e. have most of their vertices with the same labels and 
colours and the induced subgraphs of these vertices coincide including the edge colours; for 
the precise definition of what "agree" means, one should see the formal proof below. It is 
now intuitively clear why a yes-instance G of the forbidden patterns problem should be 
homomorphic to the universal graph U: the vertices of G can be labelled so that any two 
adjacent vertices get different labels, then one can choose a good vertex- and edge-colouring 
of G, and because of the construction of U now every vertex u in G can be mapped to the 
vertex of U that represents the small neighbourhood of u rooted at u. It is straightforward 
to see that the mapping preserves edges. 

The universal graph U has a very useful property, namely every small neighbourhood of 
U rooted at a vertex v is homomorphic to the small graph represented by the vertex u (see 



Lemma 2.2 below). This property immediately implies that a no-instance of the forbidden 
patterns problem cannot be homomorphic to U. Indeed, suppose for the sake of contradic- 
tion, there is a no-instance G that is homomorphic to U. Fix the colouring induced by the 
homomorphism and observe that there is a homomorphism from the forbidden pattern F 
into G. The composition of the two homomorphisms gives a homomorphism from F into 
U, and by the property above, by another composition, we get a homomorphism from the 
forbidden pattern F to some small graph represented by a vertex of U. This gives a con- 
tradiction with our construction as we have taken small no-instances only to be represented 
by the vertices of the universal graph. 



Example 2.1. We illustrate the construction of Theorem 1.7 for our final example Edge- 
No-Mono-Tri in Figure [3] for inputs of bounded degree b > 3. Any input G can be 
labelled by elements from {1, 2, . . . , 10} such that, for every vertex x in V(G), the vertices 
at distance at most 2 (the diameter of a triangle plus one) of x have a different label. 

The remainder of this section is devoted to the formal proof of Theorem |1.7| 

Let b be a positive integer and 5 be a set of forbidden patterns. We write 5(G) to 

denote the diameter of a graph G: that is, the maximum for all vertices x in V(G) of the 

maximum distance from x to any other vertex y in V(G). 

\=o L 



Let m := max{<5(F) such that (F, f v , f E ) £ £}. Let X := 1 + £™ 6(6 - !)■?' . 
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(Edge) coloured graph S\ 



(Edge) coloured graph 52 





The coloured graph induced 
by the vertices at distance at 
most one from the vertex 1 is 
identical in both S\ and S2 



The coloured graph induced 
by the vertices at distance at 
most one from the vertex 2 is 
identical in both S\ and S2 





The template U has the edge 
»(2,S 2 ) 



Figure 3: Illustration of the construction for Edge-No-Mono-Tri. 



Construction of U. Let S be the set of connected graphs (S,s ,s ) that are valid w.r.t. 
5, such that V(S) is a subset of {1,2,..., X}. Let U be the graph with: 

• vertices (v, (S, s v , s £ )), where (S, s v , s £ ) G § and v G S; and, 

• such that (v, (S, s v , s £ )) is adjacent to (v f , (S', s' V , s /£ )) if, and only if, the following holds: 
(i) (v,v') belongs to both E(S) and E(S'); and, 

(ii) the induced coloured subgraph of S induced by every vertex at distance at most m 
from v (respectively, v') is identical to the induced coloured subgraph of S' induced 
by every vertex at distance at most m from v (respectively, v'). 

We shall prove shortly that U is a yes-instance witnessed by the following "universal 
colours" defined as follows, 

• u v (v , (S, s v , s £ )) := s v (v ), for every vertex (S, s v , s & ) in V(U); and, 
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• u E ((v, (S, s v , s E ))(v', (S', s' V , s /£ ))) := s 8, (v,v'), for every edge 

((v,(S,s v ,s E ))(v',(S',s' V ,s ,E -)))m E{U). 
We first need the following lemma. 

Lemma 2.2. Let (v, (S, s v , s £ )) in V(U). Let (B,b v ,b E ) be the coloured graph induced by 
all vertices at distance at most m from (v, (S, s v , s )). Then, there exists a homomorphism 
from (B, b v , 6 £ ) to (5, s v , s £ ) that preserves the colours. 

Proof. Let (v 1 , (5', s' V , s ,£ )) in V(B). We set h(v', (S 1 , s' V , s /£ )) := v' . By induction on 
the distance from (v, (S, s v , s £ )) to (V, (S", s /V , s /£ )), using (i), it follows that the vertex 
v' belongs to V(S) and that h is a homomorphism. Similarly, using (n) it follows that h 
preserves colours. □ 

Claim. (U,u v ,u E ) is valid with respect to the forbidden patterns 

Proof. Assume for contradiction that (U,u v ,u E ) is not valid and that there exists some 
forbidden pattern (F, f v , / £ ) in ^ and some homomorphism /' from F to U that preserves 
these colours. Since the diameter of F is at most m, there exists a vertex x in V{F) such 
that every vertex of F is at distance at most m. Hence, it is also the case for f'{x) in the 



homomorphic image of F via /'. By lemma 2.2 there exists a homomorphism h from F to S, 
where f'(F) = (v, (S, s v , s £ )). Both homomorphisms are colour preserving, thus composing 
these two homomorphisms, we get that ho f is a colour-preserving homomorphism from F 
to S. However, by definition of S, the coloured graph (S, s v , s £ ) is valid with respect to the 
forbidden patterns 5- We reach a contradiction and the result follows. D 

Claim. Yes-Instances Are Homomorphic to U. 

Proof. Let G be a graph of bounded degree b for which there exist g v : V{G) — * V and 
g £ : E(G) — > £ such that (G, g v , g E ) is valid w.r.t. Since G has bounded degree b, for 
every vertex x in V(G), there are at most X — 1 vertices y at distance at most m from x. 
Therefore, there exists a map \ from ^(G) to {1,2, . . . ,X} such that every two distinct 
vertices within distance m or less take a different colour via x- Thus, for every vertex x in G, 
the subgraph of G induced by the vertices at distance at most m of x can be identified (via 
the labelling \) to a graph S x with domain {1,2,..., X}. Similarly, the restriction of g v and 
g £ to this subgraph induce colour maps sj and sf of S. We set a(x) := (x{%), {S x , s x , s £ )). 
It follows directly from the definition of U that a is homomorphism that preserve colours. D 

Claim. No-instances are not homomorphic to ?7. 

Proof. Let G be a graph of bounded degree 6 that is a no instance of the forbidden patterns 
problem represented by J an d assume for contradiction that a is a homomorphism from 
G to U. The homomorphism a together with the universal colouring (U, u v , u £ ) induces 
colourings g v and <? £ as follows: For every vertex x in V(G), set g v {x) := u v {a{x)); and, 
for every edge (x,y) in E(G), set g E (x,y) := u E (a(x) , a(y)) . Since G is a no instance, 
there exists a forbidden pattern (F,f v ,f e ') in # and a homomorphism f from F to G 
that preserve these colours. Composing the two homomorphisms, we get that a o /' is a 
homomorphism from F to U that preserves the colours of -F and £/. This contradicts the 
fact that (U,u v ,u £ ) is valid w.r.t. □ 
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This concludes the proof of Theorem 1.7 



3. Low Tree-depth decomposition. 



In this section we give a proof of Theorem 1.9 Before moving to the formal proof, 
let us give an informal outline. Given a forbidden patterns problem, we need to build a 
universal structure U such that, for every input structure S (that comes from a class % 
that has low tree-depth decomposition) , S is a yes-instance of the given forbidden patterns 
problem if, and only if, S is homomorphic to U. Recall that we use the word universal 
structure with a different meaning to that of Frai'sse, in particular U has to be finite rather 
than infinite and is universal w.r.t. the existence of homomorphisms rather than induced 
substructures (i.e. existence of embeddings). Assume for now that the forbidden patterns 
problem in question has a single colour. One of the key properties for building such a finite 
U is that of bounded tree- depth. It turns out that though the size of a structure of bounded 
tree-depth may be arbitrarily large, the size of its core is bounded. Recall that the core of 
a structure S is the smallest structure that is homomorphically equivalent to S. Let Y p be 
the disjoint union of all cores of structures of tree-depth at most p that are valid (w.r.t. our 
fixed forbidden patterns problem). Note that Y p is finite and for any structure S of tree- 
depth at most p, S is homomorphic to Y p if, and only if, S is valid. The next key ingredient 
is that the inputs have low tree-depth decomposition: that is any input structure can be 
decomposed into a fixed number of parts, say q, so that any p < q parts induce a structure 
of tree-depth at most p (here, q depends on p and the considered class of structures). So, 
given some input S together with such a decomposition, if the largest forbidden pattern 
has size p then it suffices to check for any choice of p parts of the input, that the structure 
induced by these p-parts is valid, or equivalently, that it is homomorphic to Y p . Finally, 
we use the key concept of pth truncated product. This concept allows us to translate the 
existence of homomorphisms to a structure T, for any p — 1 parts of a p partitioned input S, 
to the existence of a homomorphism to the pth truncated product of T. Hence, by taking a 
sequence of suitable truncated products of Y p , we get the desired finite universal structure 
U. Note that we assumed that the forbidden patterns problem had a single colour. In order 
to get our result in general, we adapt the above ideas and concepts to coloured structures 
in the same spirit as in the previous section. 

3.1. Tree-depth and Elimination Tree of a Structure. Following the theory of tree- 
depth of graphs introduced in [SO], we develop elements of a theory of tree-depth for struc- 
tures. 

Let 5 be a structure. We denote by 5£<j the hypergraph induced by S, that has the 
same domain as S and whose hyperedges are the sets that consists of the elements that 
occur in the tuples of the relations of S. If !H is an hypergraph and r is an element of the 
domain of J{ then we denote by "K\ {r} the hypergraph obtained from "K by deleting r from 
the domain of "K and removing r from every hyperedge in which it occurs (e.g. {o, b, r} is 
replaced by {a, b}). A connected component IKj of !Ks \ {r} induces a substructure Si of S 
in a natural way: Si is the induced substructure of S with the same domain as %i. If S is 
connected, then we say that a rooted tree (r, Y) is an elimination tree for S if, and only if, 
either |,S| = {r} and |y| = r, or for every component Si of S (1 < i < p) induced by the 
connected components HQ of "Ks \ Y is the tree with root r adjacent to subtrees (rj, Yi), 
where (r,, Yi) is an elimination tree of Si. Let F be a rooted forest (disjoint union of rooted 
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trees). We define the closure of F clos(F,o~) to be the cr-structure with domain \F\ and all 
tuples Ri(xi,X2, . . . ,x ri ) such that the elements mentioned in this tuple {xi\l < i < r^} 
form a chain w.r.t. <_p, where <f is the partial order induced by F, i.e. x <f y if, and 
only if, x is an ancestor of y in F. The tree-depth of S, denoted by td(S'), is the minimum 
height of a rooted forest F such that 5 is a substructure of the closure of F, clos(F, a). 
These notions are closely related. 

Lemma 3.1. Let S be a connected structure. A rooted tree (r, Y) is an elimination tree for 
S if, and only if, S is a substructure of clos(Y, a). Consequently, the tree-depth of S is the 
minimum height of an elimination tree. 

Proof. We prove this result by induction on \S\. If S has a single vertex r then the result 
holds trivially. Assume that the above equivalence holds for every connected structure of 
size at most n — 1 and assume that S has size n. 

Let (r, Y) be a tree that consists of a root r adjacent to rooted subtrees (r-j, Y,j). The tree 
(r, Y) is an elimination tree for S if, and only if, the subtrees (rj,Yj) are elimination trees 
for the components Si induced by the connected component "Hi of "Ks \ { r }- By induction 
Si is a substructure of clos(Yj,cr). Moreover every tuple t in a relation of S either does 
not mention r and occurs in a single component Si or t mentions r and apart from r only 
elements from a single structure Si. Hence, equivalently we have that 5 is a substructure 
ofclos(Y,a). □ 

We will need the following lemma later. 

Lemma 3.2. A rooted tree (r, Y) is an elimination tree for a structure S if, and only if, it 
is an elimination-tree for its Gaifman graph Ss- 

Proof. The forward implication holds since every edge between two elements x and y in the 
Gaifman graph is induced by at least one tuple in some relation of S in which both x and y 
occurs. Thus, in particular x and y occur on the same branch in an elimination tree of S. 

Conversely, every tuple induces a clique in the Gaifman graph and all elements of a 
clique must occur on the same branch of an elimination tree. Thus, an elimination tree for 
Ss is also an elimination tree for S. D 



3.2. Tree-depth and Cores. We show that a coloured structure % of bounded tree-depth 
has a core of bounded size. Recall that a retract of a structure S is an induced substructure 
S' of S for which there exists a homomorphism from S to S' . A minimal retract of a 
structure S is called a core of S. Since it is unique up to isomorphism, we may speak of the 
core of a structure [E]. This notion extends naturally to coloured structures [26 . 

We say that a (colour-preserving) automorphism [i of a (coloured structure) S has the 
fixed-point property if, for every connected substructure T of S, either //(T) nT = or there 
exist an element x in T such that fi(x) = x. We say that n is involuting if fj, o (j, is the 
identity. 

Theorem 3.3. There exists a function i):NxN-*N such that, for any coloured structure 
(S,s v ,s E ) such that \S\ > r/(N,td(S)) and any mapping g : \S\ — > {1,2, ... ,N}, there 
exists a non-trivial involuting g-preserving automorphism /i of (S, s v , s £ ) with the fixed- 
point property. 
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Proof. Let (S, s , s £ ) be a coloured structure with p > 1 connected components (<%, s^, sf) 
where 1 < i < p and let g : jS 1 ) — > {1,2, . . . , iV}. Let F be a rooted forest that consists 
of rooted trees (r^,!^), where 1 < i < p, such that (ri,Yi) is an elimination tree for Si of 
height at most td(S'). We prove this result by induction on td(5). 

If td(S') = 1 then every (ri,Yi) has height 1 and every (Si,sf,sf) is a coloured self- 
loop (a self-loop is a structure with a single element). Let \a\ be the number of relation 
symbols in a. There are at most N x x |£| x 2^ g-valued coloured self-loops. Hence, 
we set r](N, 1) := N x |V| x |£| x 2H and for any (S,s v ,s E ) satisfying \S\ > 7](N,1) and 
any mapping g from \S\ to {1,2 .. . ,N}, there exists a non-trivial involuting ^-preserving 
automorphism /i of (S, s v , s £ ) that has the fixed point property (simply choose for [i an 
automorphism that permutes two identical coloured self- loops with the same g value). In 
the rest of the proof, we shall write that \i is a "good" (7-preserving automorphism for short. 

Assume that the result holds for every coloured structure of tree depth at most n, and 
let S be a structure with tree-depth n + 1. Assume first that p = 1. That is, F consists of 
a single rooted tree (r, Y). Let (rj,Yj), 1 < j < q be the subtrees of Y where rj is a child 
of r in Y. We wish to define a mapping g' over S" \ {r} such that </(x) describes both g(x) 
and the relationship of x and r in S. Let iV(x, r) be the coloured structure (together with 
the restriction of g) that is the substructure of S induced by the following set of elements: 

^J{e hyperedge of "Ks s -t- x £ e and r G e}. 

If this set is empty, we set N(x, r) to be 0. Let G be the set of such neighbourhoods N(x, r) 
with two constants x and r, considered up to isomorphisms. We also assume that is an 
element of 0. Since a, £ and V are fixed, it follows that is finite. We define g' as the 
mapping from \S\ \ {r} to N x <d such that g'(x) := (g(x), N(x, r)), where N(x,r) belongs 
to O and is isomorphic to N(x,r). Hence, by induction if \S \ {r}\ > i](N\Q\,n), there 
exists a "good" (/-preserving automorphism fi' of S \ {r}. Let // be the extension of fi' to 
S such that /J,(r) := r. By construction, fi is a "good" ^-preserving automorphism. 

Assume now that p > 1. If one of the components (Si, sf , sf) with elimination tree 
(ri,Yi) has size strictly greater than r](N\Q\,n) + 1, then from the previous case, it has a 
"good" ^-preserving automorphism m which we can extend by the identity into a "good" 
^-preserving automorphism fi of the whole structure. Assume now that every component 
(Si, sf , sf) has size at most r/(N\Q\,n) + 1. The number ((N,k) of coloured structures 
(together with a mapping g to a set of size N) of size at most k considered up to isomorphism 
depends only on iV and k (and the constants a, V and £). Hence, if p > ((N, rj(N(\Q\, n) + l) 
then there must be at least two components that are isomorphic (also w.r.t. both colours and 
g- values). Hence, /i is a "good" ^-preserving automorphism, where /U is the automorphism 
that exchanges these two components and leaves the element of any other component fixed. 
Thus, we may set, 

V (N,n + l) := (rj(N\@\,n) + l) x £(N, v(N\@\, n) + l) . 

This concludes the proof. □ 

Theorem 3.4. Let (S,s v ,s E ) be a coloured structure. If \S\ > i](l,td(S)) then (S,s v ,s £ -) 
maps homomorphically into one of its proper induced substructure (Sq,Sq,Sq). Conse- 
quently, the core of (S,s v ,s E ) has size at most rj(l, td(S*)). 

Proof. By the previous theorem, if \S\ > r/(l, td(S')) then there exists a non-trivial involuting 
automorphism fi of (S, s v , s £ ) with the fixed-point property. Let F be the set of fixed-points 
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of /x Let S' be the substructure of S induced by | S| \ \F\ . Let S" be a connected substructure 
of S' . Since \i has the fixed-point property and S" has no fixed point by definition, we know 
that /u(5"') fl S" = 0. Note that there can not be any tuple t in a relation of S' that involves 
simultaneously elements of S" and fJ>(S") (Otherwise, the substructure S" of S' induced by 
\S"\ and the element of t would be connected and fi(S' t ')r\S' t ' ^ 0). There could be however a 
tuple that involves simultaneously elements of F, S" and n(S"). We need a slightly stronger 
result than the previous theorem. Note that in the previous proof, given a structure S, we 
can fix a tree decomposition (r,Y) of height td(5) with subtrees [ri,Yj) that corresponds 
to substructures Si of S, and subsequently at the induction stage, rather than using any 
tree-decomposition of the structures Si, we can assume that (rj, Yj) is used instead. With 
this further assumption, we ensure that the automorphism fj, we build has still the required 
properties, and moreover that there is no tuple that involves simultaneously elements of 
F,S" and fJ.(S"), for any connected substructure S" of S' . 

Hence, starting with two empty sets A and B, we can inductively pick a connected 
component S" of S' , add S" to A and fJ>(S") to B until S' is partitioned into A and B. 
By construction, there is no tuple involving elements of both A and B (and possibly some 
element of F). Let h be the mapping such that h{x) := fi(x), if x 6 B, and h{x) := x, 
otherwise. By construction of fx, A and B, it follows that h is a homomorphism from 
(S,s v ,s E ) to (So, s o > s o)' the substructure of (S, s v , s £ ) induced by \F\ U A. Since \i is non- 
trivial, B ^ and (So, sjf, s £ ) is a proper induced substructure of (S, s v , s £ ). This proves 
the first claim. 

For the second claim, we apply inductively the first claim until we get a proper in- 
duced substructure (S*,s+, sf) of size at most r/(l, td(S')). Thus, (5^, sj, s £ ) is an induced 
substructure of (S, s v , s £ ) in which (S, s v , s £ ) maps homomorphically into (composing the 
homomorphisms, we get a homomorphism). The core of (S+, s+, ) is also the core of 
(S, s^, s e ) (since the two structures are homomorphically equivalent) and its size is at most 
that of (5*, sj, s £ ), which is bounded by 77(1, td(5)). □ 

Thus, we get the following result. 

Corollary 3.5. Let % be any class of coloured structures of bounded tree-depth k. Then 
the set %' of cores of structures from % (up to isomorphism) is finite. D 

3.3. Decompositions. Before we can define this concept for structures, let us briefly recall 
how the notion was first defined for graphs. In [10], De Vos et al. proved that for any proper 
minor closed class % and any integer p > 1, there exists an integer q such that for every 
graph G in % there exists a vertex partition of G into q parts such that any subgraph of 
G induced by at most p parts has tree-width at most p — 1 (existence of a low tree-width 
decomposition). Similarly, we say speak of a low tree-depth decomposition for % whenever, 
for every integer p, there exists an integer q such that any graph in % has a proper q-colouring 
in which any p colours induce a subgraph of tree-depth at most p. 

In [30], Nesetfil and Ossona de Mendez refined De Vos et al.'s result to low tree-depth 
decomposition. More recently, they reproved this result in the more general setting of 
graphs of bounded expansion without using De Vos et aL's result and obtained the following 
characterisation of low tree-depth decomposition for graphs. 

Theorem 3.6. [27] Let % be a class of graphs. % has bounded expansion if, and only if, % 
has low tree-depth decomposition. 
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We say that a class % of structures has low tree-depth decomposition if, and only if, 
for every p > 1, there exists an integer q such that for any structure S in %, there exists a 
partition of |S| into q sets such that any substructure of S induced by at most p of these 
sets has tree-depth at most p. 

Proposition 3.7. Let % be a class of structures. If % has bounded expansion then % has 
low tree-depth decomposition. 



Proof. Let S be a structure in %. We apply Theorem |3.6| to 9s, the Gaifman graph of S 
and get a vertex partition such that every subgraph of 9 s induced by at most p colours 
has a tree-decomposition of height at most p. We use the same partition for S. For every 
substructure S' of S induced by at most p parts, the tree-decomposition of 9s' is al so a 



tree-decomposition of S' (by Lemma 3.2) and the result follows. D 



Remark 3.8. We adopt a definition of low tree-depth decomposition of structures that 
seems more natural than a definition that would involve the Gaifman graph (we require 
only a vertex partition) . We do not know whether our definition is more general or not (in 
other words, does the converse implication in the previous result hold?). 



3.4. Truncated Product. We extend the definition of truncated product and adapt two 
lemmas from [30 to coloured structures. Recall first that the usual notion of product in the 
context of graph homomorphism is the following. The product of two structures A and B 
is the structure with universe the cartesian product of the universes of A and B and such 
that R((ai, bi), (02, 62) , . ■ ■ , (a n , b n )) holds if, and only if, both R(ai, 02, • • • , a n ) holds in A 
and R{b\, &2> • • ■ , b n ) holds in B. The truncated product resembles this "classical" product 
except that each component has a special "don't care" element and the domain of this special 
product consists only of tuples involving exactly one "don't care" element. 

Let (S, s v , s £ ) be a coloured structure and p > 2 be an integer. We define the pth 
truncated product of (S, s v , s £ ), to be the coloured structure (S 1 , s' V , s /£ ) defined as follows. 

• Its domain is a subset of Uf=i W l where, 

W l := {(xi,x 2 , Xi-i,*, Xi+i, ... ,x p ) s.t. VI < k < p, k / i => x fc £ \S\} 

(* denotes a new element, i.e. * \S\). 

• We restrict further W l to W % that consists of elements 

W % = (xi,X2,...,Xi-l,*,Xi+l,...,X p ) 

of W l such that there exists v £ V such that for every 1 < k < p with k 7^ i we have 
s V {xk) = v and we set \S'\ := U^-^W 1 and s /V (w' t ) := v. 

• For every relation symbol R of arity r, and every tuple (to* 1 , w t2 , . . . , w tr ) where for every 
1 < k < r, w lk belongs to W %k and 

w — , x 2 , . . . , x ik _ 1 , x, x ik+1 , . . . , x p ) 

that satisfies for every 1 < i < p, with i 1%, ■ ■ ■ , i r }'- 

— R(ti) holds in S, where U = (x- 1 ,^ 2 , . . . ,x* r ); and, 

— there exists e S £ such that for every 1 < % < p, s E (ti) = e, 

we set R(w ll ,w 12 , . . . , w/ r ) to hold in S and we set s (w %1 ,w %2 , . . . ,w lr ) := e. 
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We denote the pth truncated product by (S, s v , s £ )^ p . 

This product has two important properties: it preserves validity w.r.t. a forbidden 
patterns problem (for a suitable p); and, the existence of all "partial" colour-preserving 
homomorphisms is equivalent to the existence of a homomorphism to the truncated product 
(see Lemma 3.9 and Lemma 3.10 below). 

Lemma 3.9. Let p > 2. Let $ be a set of forbidden patterns such that for every (F, f v , / £ ) 
in we have \F\ < p. If a coloured structure (S, s v , s £ ) is valid w.r.t $ then its p-truncated 
product (S',s' ,s' ) is also valid w.r.t. J. 

Proof. We prove the contrapositive. Assume that (S',s' ,s ) is not valid w.r.t. that is 
for some (F, f v , / £ ) in there exist a colour-preserving homomorphism /' from F to S'. 
Since \F\ < p, by the pigeon-hole principle there exists 1 < iq < p such that f'(F)DW l ° = 0. 

Let 7Tj be the mapping from \S'\ \ W l ° to \S\ defined as 7r !o (w ! ) = x\ o (with the same 
notation as above). It follows directly from the definition of S' that 7Tj is a homomorphism 
from S' \ W io to S, where S' \ W io is the substructure of S' induced by \ W io . 

Hence, by composition / := 7Tj o /' is a colour-preserving homomorphism from F to S 
and we have proved that (S, s v , s £ ) is not valid w.r.t. □ 

Lemma 3.10. Let (U, u v , u £ ) be a coloured structure and letp be an integer greater than the 
arity of any symbol in a. Let (S,s v ,s^) be a coloured structure. If there exists a partition 
Vl, V2, ■ ■ ■ , V p of \S\ such that for every substructure (Si,s v , s £ ) of(S,s v ,s 8 ') induced by 
\S\\Vi there exist a colour-preserving homomorphism S{ from (Si, s^, s £ ) to (U, u v , u £ ) then 
there exists a colour- preserving homomorphism s from (Si, s v ', s £ ) to (U,u v ,u^)^ p . 

Proof. Let (U' ,u' V ,u' £ ) := (U, u v , n £ )^ p . Let x be an element of S such that x belongs to 
Vi. Then x is an element of Sk for every 1 < k < p such that k 7^ i and §k(x) is defined and 
we set: 

s(x) := (s 1 (x),s 2 (x), Sj_i(x),*, s i+ i(x), s p (x)). 

Since s~k is colour- preserving, u v (§k(x)) = s v (x) and s(x) is indeed in \U'\ by the definition 
of the truncated product. 

Let x\ , X2 , • • • , x r be elements of S that belong to the sets , Vi 2 , . . . , V{ r , respectively. 
Let R be a r-ary relation symbol from a such that R(x\, x%, ■ ■ ■ , x r ) holds in S. Then, for ev- 
ery 1 < k < p such that k {ii, %i, • • • , i r }, we have that R(s~k(%i), Sk(x2), ■ ■ ■ , s r (x r )) holds 
in U. Moreover, since §k is colour-preserving, we have that u E (s~k( x i), Sk( x 2), ■ ■ ■ , s r (x r )) = 
s^(x\,X2, • • • , x r ) and it follows by the definition of the truncated product that 
R(s(x±), S(x2), • • • , s(x r )) holds in U' and that s is a colour-preserving homomorphism. O 

Using the two previous lemmas, an easy induction provides the following result. 

Proposition 3.11. Let p be an integer greater than the arity of any symbol in a. Let $ be 
a set of forbidden patterns such that, for every (F, f v , / £ ) in 5, we have \F\ < p. Let q > p. 
Let (U' , u' V , n /£ ) be a coloured structure that is valid w.r.t 5- Let (S, s v , s £ ) be a coloured 
structure. 

Assume that there exists a partition V\, V2, ■ ■ ■ , V q of\S\, such that for every substructure 
(Si, sf, sf) of(S, s v , s £ ) induced by p subsets V^, Vi 2 , . . . , V{ p , there exists a colour-preserving 
homomorphism s~i from (Si,sf,sf) to (U' , u' V , u /£ ). 
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Then there exists a colour-preserving homomorphism s from (Si,s ,s ) to (U,u v ,u^) 
and (U, u v , u £ ) is valid with respect to where 

(U,u v ,u E ) := ([/',«'%'V (p+imp+2) - 4? . 

□ 



3.5. Universal Structure. We can now conclude the proof of Theorem 1.9, whose state- 
ment we recall now. 

Theorem. Let C be a class of structures. If C has low tree-depth decomposition (e.g. 
bounded degree, proper minor closed class, structure of bounded expansion) then C has all 
restricted coloured dualities. 



3.7 



Proof. Let (S,s ,s ) be a coloured structure such that S belongs to %. By Corollary 
there exists an integer N such that every structure S in % can be partitioned into q parts, 



such that every p parts induce a substructure of S of tree-depth at most p. By Theorem 3.4 
the core of the coloured structure induced by p parts is bounded. Let (V ,u ,u ) be the 
disjoint union of all such cores that are valid w.r.t. J (there are only finitely many). Since 
the forbidden patterns have size at most p, it suffices to check every substructure of S of 
size at most p and, a fortiori, (S, s v , s £ ) is valid w.r.t. J if, and only if, each of its coloured 
substructures induced by p parts is valid, or equivalently if every such coloured substructure 
maps homomorphically into (U ,u ,u ). 



Let (U,u v ,u E ) := (V, u' V , u ' fc )t(M-i)t(p+2)...fa By p ropos ition 3.11 if (S,s v ,s E ) 



is 



valid w.r.t. J then it is homomorphic to (U,u v ,u £ ); and, since (U, u v , u^) is valid w.r.t. ^ 
the converse holds as forbidden patterns problems are closed under inverse homomorphism. 



As in the proof of Theorem 1.7 in the previous section, forgetting the colours provides 



us with the desired template U. D 



4. Logical aspects 



4.1. MMSNPi and MMSNP2. The class of forbidden patterns problems with colours 
over vertices only, corresponds to the problems that can be expressed by a formula in Feder 
and Vardi's MMSNP (Monotone Monadic SNP without inequalities, see HUES]). Note that 
allowing colours over the edges does not amount to dropping the hypothesis of monadicity 
altogether. Rather, it corresponds to a logic, let's call it MMSNP2, which is similar to 
MMSNP but allows first- order variables over edges (just like Courcelle's MSO (Monadic 
Second Order logic) and MSO2, see [7]). 

In the following, we introduce formally MMSNPi and recall some known results; and, 
secondly, we introduce MMSNP2 and prove that it defines finite unions of problems in FPP2. 

Definition 4.1. Monotone Monadic SNP without inequality, MMSNPi, is the fragment of 
MSO consisting of those formulae $ of the following form: 

3MVt/\-.(o i ((7 J t)AA(M > t)), 

i 

where M is a tuple of monadic relation symbols (not in a), t is a tuple of (first-order) 
variables and for every negated conjunct ~^(ai A 
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• on consists of a conjunction of positive atoms involving relation symbols from a and 
variables from t; and 

• Pi consists of a conjunction of atoms or negated atoms involving relation symbols from 
M and variables from t. 

(Notice that the equality symbol does not occur in <&.) 

The negated conjuncts ->(a A/3) correspond to (partially coloured) forbidden structures 
(and this is the reason why we use such a notation in the definition rather than using 
implications or clausal form). To get forbidden patterns problems, we need to restrict 
sentences so that negated conjuncts correspond precisely to coloured connected structures. 
Such a restriction was introduced in 126 as follows. 



Definition 4.2. Let be as in Definition 4.1 on the preceding page is primitive if, and 



only if, moreover, for every negated conjunct —>(a A (3): 

• for every first-order variable x that occurs in A 0) and for every monadic symbol C 
in M, exactly one of C(x) and ->C(x) occurs in 0; 

• unless x is the only first-order variable that occurs in -i(a A (3), an atom of the form R(t), 
where x occurs in t and R is a relation symbol from a, must occur in a; and, 

• the structure induced by a is connected. 

Remark 4.3. We have altered slightly the definitions w.r.t. [26]. We now require a pattern 
to be connected. However, we have amended the notion of a primitive sentence accordingly. 
Thus, the following statement still holds as the connectivity requirement is enforced on both 
sides of the equivalence. 

Theorem 4.4. (26] The class of problems defined by the primitive fragment of the logic 
MMSNPi is exactly the class FPP\ of forbidden patterns problems with vertex colours only. 

It is only a technical exercise to relate any sentence of MMSNPi with its primitive 
fragment. 

Proposition 4.5. [26] Every sentence of MMSNPi is logically equivalent to a finite dis- 
junction of primitive sentences. 

This paper is concerned with decision problems only and we equate a problem with 
the (isomorphism closed) set of its yes-instances. Thus, we may speak of the union of two 
problems. Consequently, we have the following characterisation. 

Corollary 4.6. Every sentence in MMSNPi defines the union of finitely many problems 
in FPPl 

The logic MMSNP2 is the extension of the logic MMSNPi where in each negated con- 
junct —1 (a A /?), we allow a monadic predicate to range over a tuple of elements of the 
structure, that is we allow new "literals" of the form M(R(xx, x%, . . . ,x n )) in (3, where R 
is ra-ary relation symbol from the signature a. We also insists that whenever such a literal 
occurs in [3 then R(xi,x%, . . . ,x n ) appears in a. The semantic of a monadic predicate M 
is extended and is defined as both a subset of the domain and a subset of the set of tuples 
that occur in some input relation: that is, for a structure S, M s C \S\ UE(S). We say that 
a sentence of MMSNP2 is primitive if each negated conjunct ->(a A (3) satisfies the same 
conditions as in Definition 14.21 and a further condition: 

• if R(xi, X2, ■ ■ ■ , x n ) occurs in a then for every (existentially quantified) monadic predicate 
C exactly one of C(R(x±, X2, ■ ■ ■ , x n )) or -iC(R(xi, X2, ■ ■ ■ , x n )) occurs in (3. 



20 



F. R. MADELAINE 



It is only a technical exercise to extend all the previous results of this section concerned 
with MMSNPi and FPPi to MMSNP 2 and FPP 2 . In particular, we have the following 
result. 

Corollary 4.7. Every sentence in MMSNP2 defines the union of finitely many problems 
in FPP 2 . □ 



4.2. Edge Quantification versus Vertex Quantification. Courcelle investigated the 
difference in expressivity that adding edge set quantification provided to MSO: he proved 
that MSO2 (with edge set quantification) is more expressive than MSOi (with the more 
usual vertex set quantification) in general. However, he also showed that under certain 
restriction, edge set quantification does not add to MSO's expressivity. 

Theorem 4.8. [7J On each of the following classes of simple graphs: those of degree at 
most k, those of tree-width at most k, for each k, planar graphs, and, more generally, every 
proper minor closed class, every sentence in MSO2 is logically equivalent to a sentence of 
MSO!. 

Restricted coloured duality theorems can be reformulated in terms of expressivity of 
MMSNP2, MMSNPi and constraint satisfaction problems as the following result shows. 

Theorem 4.9. (Collapse to CSP). If a class % has all restricted coloured dualities then 
MMSNP\ and MMSNP2 are equally expressive when restricted to inputs from %. These 
logics define precisely finite unions of constraint satisfaction problems; and, in particular if 
% contains connected structures only then these logics define precisely constraint satisfaction 
problems. 



Proof. By Corollary 4.6 (resp. Corollary 4.7) every problem in MMSNPi (resp. MMSNP2) 
is a finite union of problems from FPPi (resp. FPP2). When restricted to a class % 
that has all restricted coloured dualities, every forbidden patterns problem is a restricted 
CSP. Moreover, any finite union of constraint satisfaction problems can be written using 
a sentence in MMSNPi pd] EE]- This proves that the logics MMSNPi and MMSNP 2 , 
when restricted to a class % that has all restricted coloured dualities, define precisely finite 
unions of constraint satsifaction problems. Moreover, if we assume that the input is also 
connected, then a finite union of constraint satisfaction problems is a single constraint 
satisfaction problem: indeed, its template consists of the disjoint union of the template of 
each constraint satisfaction problem. □ 

Remark 4.10. An alternative proof strategy would be to use Courcelle's method from [7J 
to build a sentence of MSOi and next to transform it hopefully into an equivalent sentence 
of MMSNPi using preservation under inverse homomorphisms as in Feder and Vardi's work 
on preservation theorem for MMSNP in [12]. However, even if successful such a proof 
strategy would only provide a proof that both logics become equally expressive and would 
not provide the collapse to (finite union of) CSP(s) as required. 

Thus, Theorem |1.7| and Theorem |1.8| reformulated using Theorem |4.9| provides us with 
the analogous result for MMSNP to Courcelle's result for MSO. 

Corollary 4.11. On each of the following classes of simple graphs: those of degree at most 
k, those of tree-width at most k, for each k, planar graphs, and, more generally, every 
proper minor closed class, every sentence in MMSNP2 is logically equivalent to a sentence 
of MMSNP!. □ 
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Courcelle has recently extended Theorem 4.8 to hypergraphs, which can be stated as 
follows in the case of graphs. 

Theorem 4.12. [5] Let k > 0. Every sentence of MSO2 is logically equivalent to a sentence 
of MSO\ over uniformly k-sparse graphs. 

Recall that a graph G is uniformly k-sparse if, and only if, every subgraph H of G is 
A;-sparse, that is \E{H)\ < k.\V{H)\. This definition is equivalent to the following condition: 
G has an orientation such that every vertex has in-degree at most k (see Lemma 3.1 in |8j). 

Remark 4.13. It follows directly from the definitions that a class of graphs with bounded 
expansion is uniformly fc-sparse for some fixed k. However, we know that the converse 
implication can not hold as 2-sparse graphs do not have all restricted dualities. Indeed, we 



prove in Proposition 4.14 (see below) that there exists a problem definable by a first-order 
sentence of MMSNPi that is not a CSP even when restricted to uniformly 2-sparse graphs. 
However, this does not exclude that MMSNPi and MMSNP2 are also equally expressive 
when restricted to uniformly /c-sparse graphs. 

The following was observed independently in [29 j . We provide our own proof for com- 
pleteness. 

Proposition 4.14. Uniformly 2-sparse graphs do not have all restricted dualities. 

Proof. Consider the problem Tri-Free whose yes-instances are triangle-free graphs. Con- 
sider the graph G n with n special elements, such that every pair of distinct special elements 
are linked by a path of length three (using additional vertices). We give an orientation to 
each edge on each of the path as follows: edges with a special vertex become arcs originating 
from this special vertex; and other edges are oriented arbitrarily. Note that every special 
vertex has in-degree zero and every non-special vertex has in-degree at most 2 (since it has 
degree at most 2). This shows that our graph is uniformly 2-sparse. 

Moreover, by construction G n is triangle-free and no homomorphic image of this graph 
can identify special elements. The family of graphs (G n ) ne N provides us with proofs (so- 
called witness family in [26_.) that the problem can not be a finite union of (finite) constraint 
satisfaction problems even when restricted to graphs that are uniformly 2-sparse. D 



4.3. Infinite constraint satisfaction problems and MMSNP2. Bodirsky et al. have 
investigated constraint satisfaction problems where the template is infinite. They have 
proposed restrictions that ensure that the problems are decidable (and in MP): when the 
template is countable and homogeneous in [1], and more recently to a more general case 
when the template is w-categorical in |2 a . Recall that a countable structure T is u- categorical 
if all countable models of the first-order theory of T are isomorphic to T. Denote by CSP* 
the set of constraint satisfaction problems that have a w-categorical countable template and 
belong to MP. 

Remark 4.15. In [2], the definition of CSP* is more restricted than ours. A template is 
required to be both w-categorical and finitely constrained (see definition below). However, 
the property of being finitely constrained is only used in order to enforce that the problem 
belongs to MP. This motivates our more general definition. A countable structure T is 
finitely constrained if there is a first-order expansion V of T over some expanded signature 
t' and a finite set M of finite r'-structures such that Age(T') = Forb(N'), where Age(T), 



22 



F. R. MADELAINE 



the so-called age ofT is the set of all finite induced substructures of T; and, by Forb(N), 
we denote the set of all finite structures that do not admit any of the structures from N as 
an induced substructure. 

We say that a problem Q is closed under disjoint union if for every structures A and B, 
their disjoint union A + B is a yes-instance of 0, whenever both A and B are yes-instances of 
S7. Using a recent result due to Cherlin, Shelah and Chi [6], Bodirsky and Dalmau proved 
the following result. 

Theorem 4.16. [3 j Every non-empty problem in MMSNP\ that is closed under disjoint 
union belongs to CSP*. 

It follows directly from the definition that every problem in FPPi is closed under disjoint 
union. Hence, we get the following result. 

Corollary 4.17. Every problem in FPP\ is in CSP*. Consequently, every problem in 
MMSNPi is the union of finitely many problems in CSP* . 

Since w-categoricity is preserved under first-order interpretation, we can prove the fol- 
lowing. 

Theorem 4.18. Every problem in FPPi is in CSP* . Consequently, every problem in 
MMSNP2 is the union of finitely many problems in CSP* . 



Proof. Note that the second claim follows from the first claim together with Corollary 4.7 
We now prove the first claim in the case of a problem £1 in FPP2. To simplify the notation, 
we assume that fl is a problem over digraphs encoded using a single binary relation E. For 
simplicity, we may also assume that there are only arc colours (vertex colours can be easily 
encoded using more arc colours and additional forbidden patterns). Let £ be the set of arc 
colours and let |£| = c. 

Consider the problem Q' in MMSNPi defined over a structure with one monadic pred- 
icate T and one ternary predicate R, given by a sentence $ with m = [logc] monadic 
predicates. We use these monadic predicates to encode the c colours in a natural way, using 
a conjunction Xa of m monadic predicates for each colour a (if necessary, $ may contain 
negated conjuncts forbidding certain combinations of monadic predicates if 2 m > c). Each 
forbidden pattern (F, / £ ) of f2 is encoded as a negated conjunct as follows: for each arc 
E(x,y) of colour a, add the literals R(x,e,y), T(e) and Xa(e). 

The following formula provides an interpretation II of the signature {E) in the signature 
(T, R): iJ)e(x, y) = 3eT(e) AR(x, e, y). By construction of f2', this interpretation II is a first- 
order reduction from £1' to f2. Note also that Q' is closed under disjunction (since every 



forbidden pattern of $7 is connected by definition of FPP2). By Theorem 4.16 there exists 
an ^-categorical structure T' such that O' = CSP(V). Let T be n(r'). By Proposition 2.7 
of [2] (page 27), it follows that T is also w-categorical. Moreover, it is not difficult to check 
that O = CSP*{T). □ 

Remark 4.19. As pointed out in [2], there are problems that are in CSP* but not in 
MMSNPi. For example, the problem over directed graphs with template induced by the 
linear order over Q. Unfortunately, this problem is not expressible in MMSNP2 either. 
In fact, we do not know whether MMSNPi is strictly contained in MMSNP2. Indeed, 
to the best of our knowledge, none of the problems used to separate MSOi from MSO2 
are expressible in MMSNP 2 . We suspect that the problem Edge-No-Mono-Tri is not 
expressible in MMSNPi and that MMSNPi is strictly contained in MMSNP 2 . 
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5. Conclusion 

Our results. In this paper, we have proved that every forbidden patterns (with colours 
on both edges and vertices) problem is in fact a constraint satisfaction problem, when re- 
stricted to a class of structures that have low tree-depth decomposition: e.g. bounded 
degree structures, a proper minor closed class of structures and more generally a class of 
bounded expansion. We derive from this result that the logic MMSNP2 (and MMSNPi) 
coincides with the class of constraint satisfaction problems on connected inputs that belong 
to a class that has low tree-depth decomposition. Together these results cover the restric- 
tions considered by Courcelle in [7] under which MSOi and MSO2 have the same expressive 
power. 

Some technical questions. Note that we do not know whether for unrestricted inputs, 
MMSNP2 is more expressive than MMSNPi. Moreover, we have seen that Courcelle's more 
recent generalisation to uniformly A;-sparse graphs [8 does not have an analog for MMSNPi, 
MMSNP2 and constraint satisfaction problems. By this we mean that the two logics could 
well be equally expressive under this restriction, but they must necessarily capture problems 
that are not constraint satisfaction problems even when restricted to uniformly fc-sparse 
graphs, for any fixed k > 2. 

Another point concerns the notion of a proper minor closed class of structures. In the 
present paper, we use the Gaifman graph to define this concept. However, it would be more 
natural and perhaps preferable to define a notion of minor for structures. The following 
definition seems reasonable. A minor of a structure S is obtained from S by performing a 
finite sequence of the following operations: taking a (not necessarily induced) substructure; 
and, identifying some elements, provided that they all occur in some tuple of some relation. 
This new definition subsumes the definition used in this paper and provokes the following 
question: Do the results of this paper hold under this new definition? A similar question 
arises for a class of structures with bounded expansion. In particular, is there a suitable 
definition that would be equivalent to low tree-depth decomposition (recall that to define 
this notion over structures we do not use the Gaifman graph)? 

Future work. Apart from the above, perhaps technical questions, there are two general 
questions that we plan to investigate in future work. The first question is related to CSP*, 
the class of (well-behaved) infinite constraint satisfaction problems introduced by Bodirsky. 
We know that any problem in MMSNP2 is a finite union of problems from CSP*. However, 
there are problems in CSP* that are not expressible in MMSNP2, which yields the following 
question. Which logic (necessarily, some extension of MMSNP2) defines precisely CSP*? 

The second one concerns restricted duality and restricted coloured duality. We have 
given some ad-hoc techniques to lift results of restricted duality to restricted coloured duality 
for some of our examples. These techniques do not need to know precisely the construction 
of the universal graph in the case of restricted duality they reduce to. Instead they rely on 
the rather restricted form of our examples. We wonder whether this is indeed an artifact 
of the restricted nature of our examples or whether this can be done in general. In other 
words, Is it the case that all restricted dualities for a class OC implies all restricted coloured 
dualities for % ? 
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Related work. Independently to our work, Kun and Nesetfil have initiated an elegant 
new approach by means of lifts and shadows in [21]. In the sequel paper [22], they state a 
theorem, which corresponds to our main result, but in the case of vertex colours only. The 
approach these authors propose relies on the fact that (restricted) coloured duality can be 
reduced to (restricted) duality over an extended signature, where the additional symbols 
are monadic and used to encode the vertex colours. Since the property of being of bounded 
expansion does not depends on the monadic predicates, this means that one only needs to 
generalise the results concerning restricted duality for bounded expansion due to Nesetfil 
and Ossona de Mendez to arbitrary relational signature. In other words, the consideration 
of vertex colouring in our proof has become unecessary. We believe that it is possible to deal 
similarly with edge colours by defining a suitable notion of lift and follow the lines of Kun 
and Nesetfil's approach. This would allow us to remove the consideration of edge-colouring 
in our proof, simplifying it further. 
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